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Abstract 

This study explores in-service elementary and secondary science teachers’ conceptions of the Nature of 
Scientific Inquiry and the influence of participation in two different Research Experience for Teacher (RET) 
programs had on these conceptions. Participant teachers attended one of two six week RET programs in which 
they worked with scientists to engage in scientific inquiry. Before and after the RETs, teachers completed the 
Views of Scientific Inquiry (VOSI) questionnaire. Teachers’ answers were analyzed to determine the degree of 
sophistication of their understanding of five facets of scientific inquiry. Both elementary and secondary teacher 
participants showed improvement in their understanding of nature of scientific inquiry as a result of program 
participation, and both programs were successful in supporting the development of inquiry conceptions, although 
secondary science teachers started and finished the RET’s with a more sophisticated understandings of scientific 
inquiry. Areas of improvement for elementary teachers included the role of questions in science and the role 
subjectivity and creativity play in the processes of science, and for secondary teachers growth was seen in the 
role of questions, the relationship of data and evidence, the distinction of experiments and other means of 
investigations, and the varied methods of science. Implications of these results are discussed. 

Keywords: nature of scientific inquiry, professional development workshop 

1. Introduction 

As described by the National Research Council, to be considered “fully proficient in science” students must be 
able to (1) know, use, and interpret scientific explanations; (2) generate and evaluate scientific evidence and 
explanations; (3) understand the nature and development of scientific knowledge; and (4) participate 
productively in scientific practices and discourse (Duschl et ah, 2007). Students’ understanding and ability to 
conduct scientific inquiry is central to each of these strands of scientific proficiency. One of the most direct ways 
of supporting the development of these proficiencies involves allowing students to participate in classroom 
inquiry. 

Despite being a major focus for science educators and teachers over many years due to its promise for enhancing 
student learning, the implementation of inquiry in K-12 science classrooms has developed in an inconsistent 
manner and met with limited success. A host of reasons exists for this omission, which includes the limited time 
to teach broad curricula required by accountability demands, a lack of materials, a lack of pedagogical 
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knowledge for inquiry, and scant curricular materials (Abrams, Southerland & Silva, 2008). Among these 
barriers to classroom inquiry and perhaps one of the most influential barriers is teachers’ limited knowledge of 
scientific inquiry. Simply put, it is difficult to teach what one does not understand, and just as this is true for 
views of the nature of science (Blanchard, Southerland & Granger, 2009), there is substantial evidence to suggest 
that most science teachers do not have an adequate understanding of scientific inquiry—that is they do not 
understand how science is done. 

According to Schwartz, Lederman and Lederman (2008), an understanding of scientific inquiry “relates to 
what/why scientists work as they do and how that knowledge is accepted within the scientific community” (p. 2). 
The understanding of the nature of scientific inquiry (NOSI) is often conflated with the nature of science (NOS), 
with the key distinction being that while the nature of science focuses on the products of inquiry, the nature of 
science inquiry focuses on the process of inquiry (Schwartz et al., 2008). 

Just as distinctions should be drawn between teachers’ understanding of NOS and NOSI, it is necessary to 
distinguish between teachers understandings and enactment of classroom inquiry and their understandings of 
scientific inquiry. Although a significant body of research exists concerning teachers’ abilities to enact inquiry in 
the classroom (Abrams et al., 2008; Capps, Crawford, & Constas, 2012), far less research explores teachers’ 
understanding of scientific inquiry (Schwartz et al., 2008). While one’s understanding of scientific inquiry may 
influence their knowledge of classroom inquiry, it is important to recognize that these two are interrelated but 
distinct constructs. Schwartz et al. (2008) describe that the general concepts addressed in a robust understanding 
of scientific inquiry include: 

1) Questions guide investigations 

2) There are multiple methods of investigation 

3) There are multiple purposes of scientific investigations 

4) Justification for scientific knowledge 

5) Recognition and handling of anomalous data 

6) Resources, roles and distinctions between scientific data and evidence 

7) The community of practice of science. 

Although scientific inquiry is a unique construct, teachers’ understanding of NOSI can be enhanced through 
concerted professional development. Lederman and Lederman (2008) in their case study of an elementary 
teacher’s growth during professional development targeting the nature of science and scientific inquiry describe 
that at the outset of instruction, the teacher understood science to require a linear, step-by-step process that is 
controlled and objective, leading to a singular correct answer. After participation in project ICAN, the teacher 
came to understand that there is no universal step-by-step scientific method and that there are multiple methods 
accepted in science. She also came to understand that science begins with a question that then guides the 
procedures used in its investigation. 

Cakir (2004) examined the development of preservice secondary science teachers’ understanding of nature of 
science and scientific inquiry (NOS and NOSI) as a result of engagement with a computer simulation targeting 
Mendelian genetics concepts. Before participation, the teachers held uninformed understandings of these 
constructs. Afterwards, the participants developed a more informed understanding along the following lines: 
(a) the iterative nature of scientific inquiry; (b) the tentativeness of specific knowledge claims; (c) the degree to 
which scientists rely on empirical data, as well as broader conceptual and metaphysical commitments, to assess 
models and to direct future inquiries; (d) the need for conceptual consistency; (e) multiple methods of 
investigations and multiple interpretations of data; and (f) social and cultural aspects of scientific inquiry. Again, 
professional development experiences evince promise in developing two specific aspects of a teachers’ views of 
scientific inquiry—specifically that there are multiple methods of investigations and multiple valid 
interpretations of a data set. 

Traditional conceptualizations of science are not held only by educators. Kennedy, Yezierski, and Herrington 
(2008) demonstrated that chemistry college faculty, undergraduate science majors and chemistry teachers hold a 
deep understanding of content although they maintain naive conceptions of a singular scientific method and the 
idea that the processes of science properly followed allow for the identification of a ‘truth’ about nature. These 
results provide evidence that understandings of scientific inquiry develop separately from understanding of 
science content knowledge. 
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Although work focusing on learner’s understandings of scientific inquiry is far more sparse than work focusing 
on the nature of science (Khishfe &Abd-El Khalick, 2002), scholars acknowledge that the two can and should go 
“hand in hand” in instruction (Lederman & Lederman, 2008). If the teacher education community is to help 
prepare teachers to structure science instruction in ways that will enhance students’ science proficiency, we must 
focus on ways to support teachers’ development of their knowledge in this area. Further research remains 
necessary in describing teachers’ understandings of the processes of science, the way in which science develops 
the knowledge it produces, as well as describing the effectiveness of professional development efforts in shaping 
teachers’ knowledge in this area (Capps et al., 2012). 

One form of professional development that has particular promise in shaping teachers’ understanding of scientific 
inquiry involves Research Experience for Teachers (RET), often supported by the National Science Foundation. 
Many RET programs now exist and nearly as many different strategies are used by those programs to support 
teachers’ needs (Granger & Flernkind, 1999). The traditional format is for the RET to place teachers in the research 
lab of a practicing scientist (Schwartz, Westerlund, Garcia, & Taylor, 2010). Another, less common format for an 
RET experience combines science content experience with immersion in a model of inquiry-based science 
teaching (Blanchard et al., 2009). The difference between the two models concerns the relative weight each places 
on engaging in scientific research versus an emphasis on understanding the role of scientific inquiry in meaningful 
science teaching. Although different approaches may produce different benefits for teachers, the impact of these 
different models on teachers’ understanding of scientific inquiry remains unknown and serves as the focus of the 
study described here. 

2. Research Question 

As part of a larger research project, in this research we sought to describe how participation in two contrasting RET 
programs supported the development of teachers’ understandings of the NOSI. In this effort our research questions 
included: 

1) Does participation in a Research Experience for Teachers Program shape science teachers’ understandings 
of scientific inquiry? 

2) What are the patterns of change in teachers’ understanding of scientific inquiry as a result of participation 
in RET programs? 

3) Is there a difference in the effectiveness of two different models for RET programs (SciPed and SciRes) in 
shaping elementary and secondary teachers’ understanding of scientific inquiry? 

3. Methods 

This research project is part of a larger project examining the influence of RET programs on teachers knowledge, 
beliefs and classroom practices (see Golden et al., 2011 for an extended examination of the wider study). The 
research examined here used data gathered from teachers before and after participation in one of two RET 
professional development experiences to track the changes in their understandings of scientific inquiry 

Contexts: Contrasting RET Programs 

The regional location of the study centers on a large research extensive university in the Southeast United States. 
The university in which this study took place is home to two different approaches to Research Experience for 
Teachers, the Science Research Model and the Science Pedagogy Model. 

3.1 Science Research (SciRes) RET Model 

Funded by the NSF (supplement to DMR-0084173), this RET program has attracted teachers from eight states. 
Fifty-six scientists and researchers have served as mentors. The primary focus of the SciRes RET program 
involves participation in authentic, engaging scientific research. While offering many opportunities for teachers 
to learn about frontier science and/or rejuvenate their interest in science, the explicit focus on translating these 
experiences into teachers’ practice is precluded by their intense research contexts. The SciRes RET model 
closely resembles the structure of many RET’s nationwide. At the initial stages of this research, the director of 
the program outlined that the goal of the program is 

... to provide teachers with a real world research experiences. So, the purpose as far as the Center is concerned is 
to get teachers involved in real research, not a project but real research. Sometimes, that is doing part of what the 
researchers are already doing in their lab. And sometimes, the researcher and the teacher come up with the 
project. They can do while they are here but it has to be research-based. (Director of SciRes Model, personal 
inteiview) 
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All participating teachers are placed in one facility, the International Magnetic Laboratory (IML), for 6 weeks 
during the summer. A typical day consists of 6 hours in the laboratory and 2 hours in one of the following 
activities: science seminar, colloquium, workshop-type teaching sessions, strategy sharing, or peer mentoring. 
On a weekly and rotating basis, the participants are asked to conduct an inquiry lesson from their own 
classrooms with the others, and a reflective discussion about the activity follows. 

Having teachers participate in authentic, on-going scientific research is the primary goal for the program, and 
because there is such a wide variety of research conducted at the IML, teachers are exposed to diverse research 
areas. Research at the IML spans all disciplines of science-biology, chemistry, physics, medicine, earth 
science-and, while teachers work in only one lab, through the seminars and colloquia, they are exposed to 
research from all areas of the laboratory. Additionally once during their time at the 1LM, individual teachers 
engage the rest group a tour of their laboratory space and describe the nature of their work and research in that 
space. 

3.2 Science Pedagogy (SciPed) RET Model 

Developed with funding from the NSF (ESI-9819431), the SciPed Model engages teachers in scientific research 
and an in-depth study of what this means for their teaching practice. During the past several years, over 120 
elementary-, middle-, and high-school teachers have participated in the SciPed RET program. This RET was 
designed with the assumption that research experience offered in tandem with reflection on the teaching of 
inquiry is essential for teachers to internalize aspects of inquiry. 

In the SciPed model, a veteran research scientist and one master teacher are involved full-time for 6-weeks 
working alongside participating teachers in all research and pedagogy sessions. Teachers experience all stages of 
scientific inquiry including original observation of a scientific phenomenon; development of their own research 
questions and hypotheses about it; development of the research methodology to test their hypotheses; the process 
of research; data organization and analysis; and reporting of results. 

Specifically, the SciPed RET provides teachers with experience in making original observations on marine 
organisms to arouse their curiosity. They perform short-term research in ecology and ethology, research that 
does not require extensive prior subject-matter expertise on their part or complicated instrumentation. Structured 
inquiry, facilitated by program staff, begins with the teachers’ observations, extends through hypothesis 
development and testing, data analysis, inteipretation, and reporting of results. The scientists guide but do not 
prescribe the research process, so each individual makes an intellectual investment in the discovery of 
knowledge that is new to the teacher (if not to science). Drawing from their science research, teachers engage in 
reflection upon the pedagogical features of their research experience using a hermeneutic dialectic (discussion / 
journal writing / written instructor responses / discussion / journal clarification / written instructor responses) 
process. A master teacher, a facilitator in the program, explained the goal of the program as “to help teachers 
implement more inquiry-based teaching into their teaching practice” (Master teacher, OSTA, personal 
interview). 

3.3 Participants 

This study was conducted on three cohorts of elementary and secondary teachers who participated in the 
programs during the summers of 2008, 2009 and 2010. (See table 1). The average number of years of teaching 
experience for the group approached 9 years, with most participants coming into the programs with 4 years of 
experience. In terms of gender, 53 participant teachers were female and 35 of them were male teachers. The 
group was also diverse in terms of the amount and nature of professional preparation and professional 
development experienced. The one factor that spans each of them was their willingness to engage in extensive 
professional development as represented by their application to the RET programs. 


Table 1. Grade level distribution of teacher participants 


Grade Level 

SciPed 

SciRes 

Total 

Elementary 

11 

11 

22 

Secondary 

18 

15 

33 

Total 

29 

26 

88 
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3.4 Data Collection 

Data were collected using the Views of Scientific Inquiry (VOSI) instrument appropriate for their grade level 
teaching placement. The VOSI is a multi-item open-ended survey that measures a range of conceptions related to 
scientific inquiry developed by Schwartz et al (2008). (See Appendix A for the survey.) The version of the 
survey employed for this study assessed five aspects of teachers’ understanding of the nature of scientific inquiry 
(role of questions in guiding scientific investigations, relationship between data, analysis and evidence, 
experiments’ distinction from other forms of investigation, role of subjectivity and creativity in scientific 
procedures and the varied methods of science). 

Each participant completed the survey before beginning the professional development experience, then again 10 
weeks after completion of the program. 

3.5 Data Analysis 

To assess the open-ended VOSI items for the elementary and secondary instruments, the research team 
developed a scoring rubric. The researchers, after piloting the rubric with an initial set of VOSI responses, 
employed a 3 level scoring system to categorize the responses. The three levels were: Naive, Informed and 
Sophisticated. Each level scored from 1, 2 and 3 respectively to code each VOSI response. At the outset of 
coding, two researchers scored each participant’s answers separately, then met to discuss their results. The first 
round of data analysis on 20 surveys resulted in a low inter-rater reliability, as measured by Cohen’s Kappa 
(1968) (0.48). Further iterations of this process allowed for modification and refinement, developing consensus 
around a final version of the VOSI rubric. (See Appendix A for the final scoring rubric.) The researchers 
achieved substantial agreement (K = 0.78) using this final version of the VOSI rubric to analyze 41 sets of 
responses from subjects. Four researchers were assigned to score half of the remaining VOSI questionnaires, 
both pre and post, resulting in two scores per question for each VOSI instrument. When score discrepancies 
occurred, a third researcher scored the item and the majority score was taken. 

Pre and post VOSI survey data were analyzed using the VOSI rubric to assess a respondent’s view of scientific 
inquiry. For quantitative analyses, ‘Naive’ views of science inquiry received a score of one; ‘Informed’ views 
received a two; and ‘Sophisticated’ views were scored as a three. An overall VOSI score was calculated for each 
teacher based on the scores given the responses to each of the questions, which were used in further statistical 
analyses comparing the two RET programs. Independent t-tests and paired sample t-tests were used to gauge 
statistical significance between and among group scores. 

4. Results 

4.1 Does Participation in a Research Experience for Teachers Program Shape Science Teachers ’ Understanding 
of Scientific Inquiry? 

As shown in figure 1, which includes data from all teachers participating in both programs, teachers entered the 
program with a somewhat informed understanding of scientific inquiry (indicated by mean VOSI score for 
incoming teachers of 1.75 out of 3). Participation in RET programs allowed for the modest development of the 
teachers’ understandings of the nature of scientific inquiry, as measured by changes in their scores on the VOSI 
instrument (with the mean scores after the program increasing to 2.07). There was a statistically significant 
difference between teachers’ scores before (m=1.75 + 0.548) and after (2.07+ 0.525) participation in an RET 
program (n=55), t (54) = 6.67. p<.()() 1. Thus, teachers enhanced their understanding of inquiry after participating 
in either of the RET programs. 



1.6 

1.5 


Pre Post 

Program Participation 

Figure 1. Changes in understanding of scientific inquiry—Whole group 


121 




www.ccsenet.org/ies 


International Education Studies 


Vol. 6, No. 1; 2013 


As shown in figure 2, secondary teachers entered and left the RET experience with a stronger understanding of 
inquiry (Before: m=1.97+ 0.563; After: m=2.24+ 0.517) than their elementary counterparts (Before: m=1.45+ 
0.284; After: m=1.82+ 0.454), but as shown in figure 2, elementary teachers did experience a notable 
improvement in their understanding of inquiry. There was a statistically significant change in secondary science 
teachers’ scores before (1.97^0.563) and after (2.24+ 0.517) participation in the program (n=33), t (32) = 4.80, 
p<. 001. The elementary teachers showed a statistically significant difference in VOSI scores before (1.45+ 0.284) 
and after (1.82+ 0.454) participating in the program (n=22), t (21) = 3.82, p<. 001. These data suggest that 
teachers’ knowledge both elementary and secondary changed after having participated in an RET experience. 
However, a different analysis is needed to determine what aspects of their knowledge is influenced by the RET 
experience. 

2.5 | 
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U1 
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O 
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PreAverage-VOSI PostAverage-VOSI 
-Secondary-Elementary 



Figure 2. Changes in understanding of scientific inquiry—secondary and elementary grade level teachers 


4.2 What are the Patterns of Change in Teachers ’ Understanding of Inquiry’ as a Result of Participation in RET 
Programs? 

4.2.1 Elementary Teachers 

Elementary teachers started the summer workshop with fairly naive understandings regarding the nature of 
scientific inquiry (see table 2). For each of the constructs measured, the majority of teachers held naive 
conceptions, except for of the role of questions in guiding scientific investigations, with 50% of the elementary 
teachers held informed conceptions of the role of questions. As they entered the RET experience, the elementary 
teachers struggled particularly to understand the role of subjectivity and creativity in the procedures of science 
(68% of the elementary teachers held naive conceptions of this idea) and the distinction between experiments and 
other forms of investigation (68% of the teachers held naive conceptions on this conception), Also, not 
surprisingly, many of the elementary teachers entered the RET experience with an emphasis on a singular 
scientific method (64% held naive conceptions about the scientific method and no one held a sophisticated 
understanding of this construct). 


Table 2. Categories of elementary science teachers’ VOSI responses before and after RET participation 






Elementary Teachers 




Incoming % 

Outgoing % 


Percentage Change % 

Conception of Inquiry 


Informed 

Sophisticated 


Informed 

Sophisticated 


Informed 

Sophisticated 

Role of Questions in Guiding Scientific 
Investigations 

41 

50 

9 

18 

59 

23 

-23 

9 

14 

Relationship between data, analysis and evidence 

54 

41 

5 

45 

32 

23 

-9 

-9 

18 

Experiments’ distinction from other forms of 
investigation 

68 

27 

5 

60 

36 

4 

-8 

9 

-1 

Role of subjectivity and creativity in scientific 
procedures 

68 

27 

5 

23 

59 

18 

-45 

32 

13 

The varied methods of science 

64 

36 

0 

55 

41 

4 

-9 

5 

4 
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After their RET experiences, the elementary teachers’ views of NOSI became more informed, with the majority 
holding informed views for the role of questions and the role of subjectivity and creativity and appropriate 
responses to anomalous data (see table 2). Conceptions which the majority of teachers still held naive views after 
program participation included the distinction of experiments and other forms of investigations and recognition 
of the varied methods employed in science. The elementary teachers’ views of the relationship between data, 
analysis and evidence developed slightly. 

Table 3 demonstrates the greatest degree of movement toward a sophisticated understanding of the elements of 
NOSI was found in elementary teachers’ views of the role of subjectivity and creativity. Notable gains were also 
seen in the role of questions. In contrast, the other conceptions of scientific inquiry showed less robust patterns 
of change towards sophistication. 


Table 3. Directionality of the change in elementary teachers’ conceptions of scientific inquiry 


Conception of scientific inquiry 

Group 

Direction of 
Movement 

Role of 
Questions 

Data, 

analysis, 

evidence 

Experiments 
vs. other 
investigations 

Subjectivity 

and 

Creativity 

Varied 
Methods 
of Science 


Less 

1 

O 

A 

0 



Sophisticated 

J 

4 

Z 

Whole 

No Change 

15 

12 

11 

12 

15 


More 

/: 

n 

n 

10 



Sophisticated 

O 

/ 

/ 

J 


Less 

0 

l 


0 

0 


Sophisticated 

Z 

SciRes 

No Change 

8 

7 

6 

7 

9 


More 

O 

O 

D 

A 



Sophisticated 

J 

J 

D 

4 

z 


Less 

1 



0 



Sophisticated 

z 

z 

Z 

SciPed 

No Change 

7 

5 

7 

5 

6 


More 

O 

A 


/: 

D 


Sophisticated 

J 

4 

Z 

D 

3 


As shown in Table 4, the differences described above are statistically significant, with the mean of teachers’ 
scores for the two conceptions (role of questions and the role of subjectivity and creativity in inquiry) after the 
program being statistically different than their scores obtained before the program. No statistically significant 
differences were found in teachers’ understandings of the other conceptions related to scientific inquiry (data, 
analysis, and evidence, experiments versus other investigations, and the varied methods of science). 


Table 4. Comparison of elementary teachers’ mean VOSI scores before and after program participation: Paired 


sample test. 



Paired Differences 








95% Confidence Interval of 




Std. 

Std. Error 

the Difference 

Sig. 



MeanDeviation 

Mean 

Lower 

Upper 

t df (2-tailed) 

Role of Questions 

PostPrel 

.364 .790 

.168 

.014 

.714 

2.16021.042* 

Data, Analysis & 

Post2 

.273 .827 

.176 

-.094 

.639 

1.54721.137 

Evidence 

-Pre2 






Experiment vs. other 

Post3 

.091 .811 

.173 

-.269 

.451 

.526 21.605 

investigation 

-Pre3 
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Subjectivity and 
Creativity 

Post6 

-Pre6 

.591 .734 

.157 

.265 

.916 

3.77521.00T 

Varied Methods of 
Science 

Post4 

-Pre4 

.136 .560 

.119 

-.112 

.385 

1.14221.266 


indicates a statistically significant difference. 


4.2.2 Secondary Teachers 

Secondary teachers entered the summer workshop with more sophisticated understandings of the nature of 
science than their elementary counterparts (see Figure 2). For each of the constructs measured, there were similar 
distributions of secondary teachers holding naive, informed or sophisticated views as seen in Table 5. The 
exception to this trend was found in secondary teachers’ understandings of the role of questions in guiding the 
scientific process, with only 9% of the teachers holding sophisticated view in this area before program 
participation. 


Table 5. Categories of secondary science teachers’ VOSI responses before and after RET participation 






Secondary Teachers 




Incoming % 

Outgoing % 

Percentage 
Change % 


Conception of Inquiry 

§ 

1 

Informed 

Sophisticated 

§ 

1 

Informed 

Sophisticated 

§ 

1 

Informed 

Sophisticated 

Role of Questions in Guiding Scientific 
Investigations 

40 

51 

9 

24 

45 

31 

-16 

-6 

33 

Relationship between data, analysis and 
evidence 

40 

33 

27 

18 

48 

34 

-22 

15 

7 

Experiments’ distinction from other forms of 
investigation 

27 

42 

31 

10 

54 

36 

-17 

12 

5 

Role of subjectivity and creativity in scientific 
procedures 

22 

45 

33 

12 

52 

36 

-10 

7 

3 

The varied methods of science 

27 

30 

43 

15 

21 

64 

-12 

-9 

21 


As shown in table 5, after the professional development experience, the secondary teachers’ views of the nature 
of scientific inquiry became more sophisticated, with the majority holding informed views or sophisticated views 
for all five conceptions measured after program participation. The conception with the largest gain in secondary 
teachers was the recognition of the varied methods of science. 

Not surprisingly, the greatest degree of movement toward a sophisticated understanding was found in the 
secondary teachers’ understandings of role of questions in science (see table 6). The degree of movement seen in 
the other conceptions was more ambiguous. Statistically speaking, the secondary teachers’ conceptions of 
inquiry were significantly more sophisticated after program participation for all but one conception concerning 
the recognition of the role of subjectivity and creativity in science (see table 7). This conception demonstrated 
the smallest increase in sophisticated understandings after program participation, perhaps due to the already large 
number of teachers that held a sophisticated understanding of this conception before the program began. 
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Table 6. Directionality of Change in Secondary Teachers’ Conceptions of Scientific Inquiry 


Group 

Direction of 

Movement 

Role of 
Questions 

Data, 

analysis, 

evidence 

Experiments 
vs. other 
investigations 

Subjectivity 

and 

Creativity 

Varied 

Methods 

of 

Science 



Less 

1 

'X 

D 

A 

0 


Sophisticated 

J 

J 

4 

Z 

Whole 

No Change 

20 

19 

19 

22 

20 


More 

12 

11 

11 

n 

11 


Sophisticated 

/ 


Less 

1 

1 

0 

o 

1 


Sophisticated 

J 

SciRes 

No Change 

9 

10 

8 

8 

7 


More 

C 

A 

n 

A 

n 


Sophisticated 

J 

4 

/ 

4 

/ 


Less 

0 


o 

1 

l 


Sophisticated 

Z 

J 

SciPed 

No Change 

11 

9 

li 

14 

13 


More 

n 

n 

A 


A 


Sophisticated 

/ 

/ 

4 

J 

4 


Table 7. Comparison of Secondary Teachers’ Mean VOSI Scores Before and After Program Participation: Paired 
Samples Test 

Paired Differences 


95% Confidence Interval 




Mean 

Std. 

Deviation 

Std. Error 
Mean 

of the Difference 

Lower Upper 

t 

df 

Sig. 

(2-tailed) 

Role of 
Questions 

Postl 

Prel 

.364 

.603 

.105 

.150 

.577 

3.464 

32 

.002* 

Data, Analysis 
& Evidence 

Post5 

Pre5 

.273 

.674 

.117 

.034 

.512 

2.324 

32 

.027* 

Experiments 
vs. other 
investigations 

Post3 

Pre3 

.242 

.614 

.107 

.025 

.460 

2.268 

32 

.030* 

Subjectivity 
and Creativity 

Post4 

Pre4 

.121 

.781 

.136 

-.156 

.398 

.892 

32 

.379 

Varied 
Methods of 

Post2 

Pre2 

.333 

.816 

.142 

.044 

.623 

2.345 

32 

.025* 


Science 

*indicates a statistically significant difference 


4.3 Is There a Difference Between the Impact of the Two RET Programs (Sciped and Scires) in Shaping 
Elementary’ and Secondary’ Teachers ’ Understanding of Scientific Inquiry? 

Comparing the influence of the two different RET programs on the development of teachers’ understanding of 
scientific inquiry, both programs facilitated improvement in participants’ understanding of scientific inquiry, and 
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both programs were similarly effective in supporting this development. (See figure 3). There was no statistically 
significant difference between the two programs in terms of teachers’ incoming understanding of inquiry [SciPed 
(m=1.89 + 0.517); SciRes (m=1.60 + 0.551); t (53) = 1.93, p>.05]. Likewise, at the end of the program there was 
no significant difference between the SciPed (m=2.14 + 0.465) and the SciRes (m=1.99 + 0.582) in their 
understanding of scientific inquiry, t (53) = 1.132, p>.05. Given the difference in elementary and secondary 
teachers understanding of scientific inquiry, a different picture may be found when these grade levels are teased 
apart. 


2 5 



> 0 5 


Program Participation 
— SciP — —-SciR 


Figure 3. Program comparison of changes in understanding of scientific inquiry 
4.3.1 Elementary Teachers 

When we examine the data for the elementary teachers and compare the influence of the two different RET 
programs on their understanding of scientific inquiry, the data suggest that both programs allowed for the 
development of teachers’ understandings. (See figure 4). As suggested in figure 4, there was no statistically 
significant difference between two programs in terms of teachers’ incoming understandings [SciPed (m=1.43 + 
0.34); SciRes (m=1.40 + 0.27);n=22, t (20) =.197, p>. 05. Thus, the two groups of teachers were remarkably 
similar in their understanding of scientific inquiry before the beginning the program. It is important to note, there 
was no difference in the elementary teachers’ understanding after the program participation [SciPed (m=1.77 + 
0.265); SciRes (m=1.86 + 0.561); n=22 t (20) = .49, />>.05]. Thus, there were no differences in the influence the 
two contrasting RET programs had on elementary teachers’ understanding of scientific inquiry—they both were 
similarly effective. 


2 i— 



-SciPed — • —SciRes 

Program Participation 

Figure 4. Program comparison of elementary teachers' understanding of scientific inquiry 


4.3.2 Secondary Teachers 

The data from secondary teachers suggest that both programs allowed for their understanding of scientific 
inquiry to improve (See figure 5). Flowever, it is important to note that there was a difference between the 
incoming understanding of secondary teachers across the two programs, with teachers entering the SciPed 
program demonstrating stronger knowledge of scientific inquiry than teachers entering the SciRes program 
[Secondary SciPed (m=2.18 + 0.38), SciRes (m=1.76 + 0.66) ] a difference that is statistically significant t (31) = 
2.26, p<. 05. This difference was maintained in terms of teachers’ knowledge after the program, with the 
Secondary teachers in the SciPed program (m=2.40 + .389) demonstrating a stronger knowledge of scientific 
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inquiry than the teachers in the SciRes program (m=2.08 + .599), [ t (31) = 1.85, p>.()5 | after the end of the RET 
participation. Thus, the SciPed program attracted teachers with a stronger understanding of scientific inquiry 
than the SciRes program. Although both programs allowed for the further development of teachers’ 
understanding of inquiry, the initial difference in understandings of inquiry between participants in the programs 
was maintained. 
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Figure 5. Program comparison of changes in secondary teachers' understanding of scientific inquiry 


5. Discussion 

These findings further support the limited but growing descriptions of teachers’ understandings of the nature of 
science. Echoing the teacher featured in Lederman and Lederman (2008), many of the elementary teachers in 
this study entered the professional development experience with the understanding that science follows a 
singular scientific method, as well as failing to distinguish experiments from other means of investigations in 
science, and understanding science to be a largely objective, uncreative process. 

The secondary teachers in this study entered the professional development with a more sophisticated 
conceptualization of scientific inquiry than their elementary counterparts, holding more informed views of each 
of the concepts measured (Loucks-Elorsley, Love, Stiles, Mundry, & Hewson, 2003). Secondary teachers who 
selected to participate in a relatively extensive professional development program (six weeks in duration) held an 
understanding of scientific inquiry that was overall informed at best. The fewest number of secondary teachers 
held a sophisticated conception of the role of questions in guiding scientific investigations, and the greatest 
number of teachers held a sophisticated understanding of the varied methods of science. 

These findings suggest that both elementary and secondary teachers’ understandings of scientific inquiry are 
limited, echoing what has been described for teachers’ understanding of the nature of science (Lederman & 
Lederman, 2004) and their understandings of classroom inquiry (Abrams et ah, 2008). Given the role teachers 
understandings are thought to play in shaping both what and how science teachers enact curriculum (Schwarz, 
Weserlund, Garcia & Taylor, 2010), it is clear that efforts to further support science teachers’ conceptual 
development continued to be needed. 

The RET programs designed to support teachers’ conceptual development around inquiry examined in this study 
were successful in supporting aspects of teachers’ conceptual growth. For elementary teachers, development was 
seen in teachers’ understandings of the role of questions in science and the role that subjectivity and creativity 
play in the processes of science, and particularly limited learning was documented around conceptions of 
experiments and their distinctions from other means of investigations and the varied methods of science (as 
opposed to a singular scientific method). This limited number of teachers that experienced conceptual growth in 
these two areas suggest that either these conceptions are particularly difficult to influence or the structure of the 
RET experiences was not conducive to their development for elementary teachers. 

For secondary teachers, the RET supported growth in the role of questions, the relationship of data and evidence, 
the distinction of experiments and other means of investigations, and the varied methods of science. The limited 
growth seen in secondary teachers’ conceptions around the role of subjectivity and creativity in the processes of 
science could suggest that this conception was particularly difficult to influence or that the RET experience was 
not the optimal vehicle for instruction around this conception. 

The larger amount of growth experienced by secondary teachers compared to elementary teachers is not 
surprising in light of their deep content knowledge. Their more robust content knowledge at the outset of either 
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RET program made them primed for change as a result of the experience. Perhaps elementary teachers’ greater 
naivete about the nature of scientific inquiry caused them to be less ready to learn about certain elements of 
scientific inquiry than their secondary peers. That said, the RET experiences were successful in supporting the 
learning of elementary teachers. This finding is particularly important since historically, in earlier years, RET 
experiences were often reserved for secondary teachers, as the experience was considered too challenging for 
their elementary colleagues. 

These findings also suggest that successful RET programs are only moderately successful in improving teachers’ 
understandings of scientific inquiry. Teachers’ participation in scientific inquiry at the “elbow” of a scientist was 
productive in supporting moderate growth in teachers’ views about scientific inquiry (Barab & Elay, 2001). 
Elowever, the limited number of teachers that exited the program demonstrating a sophisticated understanding of 
scientific inquiry suggests that there is “room” for improvement in the RET experience in terms of its 
effectiveness in this regard. Indeed, it was hoped that the comparison of the effectiveness of the two very 
different RET programs would provide some insight into the optimal structure of an RET to support teachers’ 
understanding of scientific inquiry. 

There was no difference in the degree to which the different RET experiences supported teachers’ knowledge of 
scientific inquiry, both being moderately successful. Thus, this analysis sheds no light on what sort of 
experiences are most productive for elementary teachers as there were no obvious differences in the conceptual 
shifts either program supported. Although both the SciRes and SciPed programs supported the development of 
secondary teachers’ understandings of scientific inquiry, the secondary teachers in the SciPed program exited the 
program with a stronger knowledge of scientific inquiry than the teachers in the SciRes program. However, these 
teachers also entered the program with stronger understandings of this construct. The similar slopes seen in 
figure 5, and the similar patterns of change in conceptions seen in table 7 suggests that both programs supported 
teacher learning about scientific inquiry. However, the SciPed program was more successful in helping move 
teachers toward a sophisticated understanding of the role of questions and the relationship of scientific data and 
evidence. These shifts may be explained by these teachers’ participation in all stages of scientific investigations 
as the science they participated in was in the pursuit of a question they themselves posed as opposed to joining 
the exploration of a pre-established scientific investigation, a feature of the SciRes program. 

In contrast, participation in the SciRes program was more successful in supporting teachers’ move toward a 
sophisticated understanding of the distinction of experiments and other forms of investigation and the varied 
methods of science. It is plausible that these shifts were enabled by teachers’ exposure to a wide range of studies 
conducted at the International Magnetic Laboratory during their sharing sessions; something not featured in the 
SciPed program more uniform, experimental, marine focused experience. 

6. Implications 

Given these findings, it seems appropriate to consider the limited degree of conceptual development experienced 
by both elementary and secondary teachers despite their engagement in extended, intensive, research-based 
experiences. This limited degree of learning can perhaps be explained by extending the work of Schwartz, 
Westerlund, Garcia, & Taylor (2010) from NOS to scientific inquiry. They describe that the “nagging 
assumption that participation in authentic scientific inquiry is sufficient to engender desired conceptions of 
NOS” (p. 29) needs to be laid to rest. The research presented suggests that this notion should be extended beyond 
the nature of science: that is, a sophisticated understanding of the nature of scientific inquiry will not be 
automatically learned simply by participation in authentic scientific inquiry. Instead, if such learning is to be 
fostered, it must be the focus of instruction. 

Our findings agree others (Barab & Hay, 2001; Blanchard & Sampson, 2011; Capps et al., 2012) who suggest 
that research experiences and other professional development experiences should be modified to include a more 
explicit component, to help teachers make sense of their experiences in terms of their own conceptual 
development. Too, the mixed results obtained when the SciRes and SciPed program suggests that a blend of 
these two approaches, one that allows teachers to experience all parts of a scientific investigation, be supported 
in reflecting on that experience, as well as have exposure to a wide range of research approaches may also be 
required if a sophisticated understanding of scientific inquiry is a goal of the RET program. 

Finally, while this research speaks to the degree to which RETs are successful in supporting teachers’ learning 
about inquiry, they fail to allow us to understand the relationship of that knowledge to teacher knowledge of 
classroom inquiry (as has been posited in the literature), or their classroom practices (Capps et al., 2011). If 
science educators are to better support teachers’ professional development as a vehicle to influence the learning 
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of students in science classrooms (Crawford, 2000), this more nuanced line of inquiry warrants sincere attention 

from researchers and educators. 

This research was funded by the National Science Foundation, DISCOVERY RESEARCH K-12 Program, 

award number #0553769. 
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Appendix A 

The VOSI Questionnaire and Scoring Rubric 


Questions and Scoring Rubric—Questions Common to Elementary and Secondary 


1. What types of activities do scientists (e.g., biologists, chemists, physicists, earth scientists) do to learn 
about the natural world? Discuss how scientists (biologists, chemists, earth scientists) do their work. 

NAIVE INFORMED SOPHISTICATED 

The answer focuses on pursuit of 
truth and/or The Science Method 
with no mention of the pursuit of 
scientific questions and/or 
description of only one type of 
scientific activity. 

The answer focuses on accurate 
description of at least 2 types of 
scientific work/process/activity, 
but little mention of pursuit of 
questions. 

The answer focuses on science 
starting with pursuit of scientific 
questions, and may also mention 
multiple (more than two) accurate 
descriptions of scientific work. 

2. (a) What does the word “data” mean in science? 

(b) Is “data” the same or different from “evidence”? Explain. Assess question two as a whole, 
looking at both A and B. 

NAIVE 

INFORMED 

SOPHISTICATED 

Answers include: data are only 
numerical and/or evidence and 
data are equivalent. 

Data can be both qualitative and 
quantitative; data and evidence are 
not the same, but the two are not 
adequately differentiated. 

Answers make the distinction 
between evidence and data, in 
that evidence is the subjective 
product of data analysis. 

3. A person interested in birds looked at hundreds of different types of birds who eat different types of 
food. He noticed that birds who eat similar types of food tended to have similar shaped beaks. For 
example, birds who eat hard shelled nuts have short, strong beaks, and birds who eat insects from tide 
pools have long, slim beaks. He concluded that there is a relationship between beak shape and the type 
of food birds eat. 

a. Do you consider this person’s investigation to be an experiment? Please explain why or why not. 

b. Do you consider this person’s investigation to be scientific? Please explain why or why not by 
describing what it means to do something “scientifically.” 

This investigation is / is not (circle one) scientific because.... 

NAIVE 

INFORMED 

SOPHISTICATED 

Identifies scenario is an 
experiment; or experiments are 
needed for an investigation to be 
considered scientific; or it is not 
characterized as an experiment 
but poorly or incorrectly 
elaborated. 

Answers include that science is 
not necessarily experimental. 

Answers include the idea that 
science works via multiple 
methods and successfully 
distinguish between the 
experiments and other forms of 
investigations. 

4. a) If several scientists, working independently, ask the same question and follow the same procedures 
to collect data, will they necessarily come to the same conclusions ? Explain why or why not. 
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b) If several scientists, working independently, ask the same question and follow different procedures 
to collect data, will they necessarily come to the same conclusion? Explain why or why not. 

c) Does your response to (a) change if the scientists are working together ? Explain. 

d) Does your response to (b) change if the scientists are working together ? 

NAIVE INFORMED SOPHISTICATED 

Same procedures produce same Recognize that same procedures Recognize that same procedures 

conclusion; different procedures may produce different conclusion, may produce different results 

produce different results, etc. with no elaboration, or given the role creativity and 

unsophisticated elaboration. subjectivity play in science; may 

also include a recognition of the 
strengths and/or weaknesses of 
working together. 


Question Specifically for Elementary Teachers 

5(e). The “scientific method” is often described as involving the steps of making a hypothesis, identifying 
variables (dependent/independent), designing an experiment, collecting data, reporting results. Do you 
agree that to do good science, scientists must follow the scientific method? 

_YES, scientists must follow the scientific method 

_NO, there are many scientific methods 

If YES (you think all scientific investigations must follow a standard set of steps or method), describe 
why scientists must follow this method. If NO (you think there are multiple scientific methods), explain 
how the methods differ and how they can still be considered scientific. 


NAIVE INFORMED SOPHISTICATED 


YES, answers describe that 

scientists must follow 

THE scientific method. 

No, answers recognized multiple 
methods of science, but incorrectly 

characterize or do not differentiate 

between methods. 

No, answers elaborate and 

give accurate representations 
of multiple methods of 

science. 


Question Specifically for Secondary Teachers 

5(s). How do scientists decide what and how to investigate? Describe all the factors you think influence the 
work of scientists. Be as specific as possible. 

NAIVE 

INFORMED 

SOPHISTICATED 

Answers focus only on The 

Scientific Method and scientists’ 

interest. 

Describes that scientists follow on 

THE Scientific Method, but list 

one other factor influencing the 
selection of topic other than 

scientist interest. 

Describes various approaches 
(beyond a singular scientific 

method) that scientists take in 

their work, and cites at least two 

factors influencing the selection 
of topic for investigation other 

than interest. 


131 




